• Ambulatory vocal acoustics, temporal dynamics, and serious mental illness 

      Cohen, Alex S.; Fedechko, Taylor L.; Schwartz, Elana K.; Le, Thanh P.; Foltz, Peter W.; Bernstein, Jared; Cheng, Jian; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019)
      Acoustic analysis of vocal expression offers a potentially inexpensive, unobtrusive, and highly sensitive biobehavioral measure of serious mental illness (SMI)-related issues. Despite literature documenting its use for understanding SMI, prior studies have largely ignored that vocal expression is highly dynamic within individuals over time. We employed ambulatory vocal assessment from SMI outpatients ...
    • Applying speech technologies to assess verbal memory in patients with serious mental illness 

      Holmlund, Terje Bektesevic; Chandler, Chelsea; Foltz, Peter W.; Cohen, Alex S.; Cheng, Jian; Bernstein, Jared C.; Rosenfeld, Elizabeth P.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-03-11)
      Verbal memory deficits are some of the most profound neurocognitive deficits associated with schizophrenia and serious mental illness in general. As yet, their measurement in clinical settings is limited to traditional tests that allow for limited administrations and require substantial resources to deploy and score. Therefore, we developed a digital ambulatory verbal memory test with automated ...
    • A Dynamic Method, Analysis, and Model of Short-Term Memory for Serial Order with Clinical Applications 

      Cheng, Sophia; Cohen, Alex S.; Holmlund, Terje Bektesevic; Foltz, Peter W.; Cheng, Jian; Bernstein, Jared; Rosenfeld, Elizabeth; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-10-06)
      This study examined the robustness of a traditional memory task when moved out of controlled traditional settings. A letter recall task was designed to be self-administered via a smart-device which assessed recall by participants’ writing their responses on the device. This enabled collection of both the letter recalled and the timing of this recall such that the temporal dynamics could be examined. ...
    • An examination of the language construct in NIMH's research domain criteria: Time for reconceptualization! 

      Elvevåg, Brita; Cohen, Alex S.; Wolters, Maria K.; Whalley, Heather C.; Gountouna, Viktoria-Eleni; Kuznetsova, Ksenia A.; Watson, Andrew R.; Nicodemus, Kristin K. (Journal article; Tidsskriftartikkel; Peer reviewed, 2016-03-10)
      The National Institute of Mental Health’s Research Domain Criteria (RDoC) Initiative “calls for the development of new ways of classifying psychopathology based on dimensions of observable behavior.” As aresult of this ambitious initiative, language has been identifi d as an independent construct in the RDoC matrix. In this article, we frame language within an evolutionary and neuro- ...
    • Extending the usefulness of the verbal memory test: The promise of machine learning 

      Chandler, Chelsea; Holmlund, Terje Bektesevic; Foltz, Peter W.; Cohen, Alex S.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-01-19)
      The evaluation of verbal memory is a core component of neuropsychological assessment in a wide range of clinical and research settings. Leveraging story recall to assay neurocognitive function could be made more useful if it were possible to administer frequently (i.e., would allow for the collection of more patient data over time) and automatically assess the recalls with machine learning methods. ...
    • The importance of loneliness in psychotic-like symptoms: Data from three studies 

      Le, Thanh P.; Cowan, Tovah; Schwartz, Elana K.; Elvevåg, Brita; Holmlund, Terje Bektesevic; Foltz, Peter W.; Barkus, Emma; Cohen, Alex S. (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-10-19)
      Poor social connection or loneliness is a prominent feature of schizotypy and may exacerbate psychosis risk. Previous studies have examined the inter-relationships between loneliness and psychosis risk, but critically, they have largely been conducted in non-clinical samples or exclusively used laboratory questionnaires with limited consideration of the heterogeneity within schizotypy (i.e., positive, ...
    • Moving psychological assessment out of the controlled laboratory setting: Practical challenges 

      Holmlund, Terje Bektesevic; Foltz, Peter W.; Cohen, Alex S.; Johansen, Håvard D.; Sigurdsen, Randi; Fugeli, Pål; Bergsager, Dagfinn; Cheng, Jian; Bernstein, Jared; Rosenfeld, Elizabeth; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-03)
      Behavioral assessment using smart devices affords novel methods, notably remote self-administration by the individuals themselves. However, this new approach requires navigating complex legal and technical terrain. Given the limited empirical data that currently exists, we provide and discuss anecdotes of the methodological, technical, legal, and cultural issues associated with an implementation in ...
    • Natural Language Processing and Psychosis: On the Need for Comprehensive Psychometric Evaluation 

      Cohen, Alex S.; Rodriguez, Zachary; Warren, Kiara K.; Cowan, Tovah; Masucci, Michael D.; Edvard Granrud, Ole; Holmlund, Terje Bektesevic; Chandler, Chelsea; Foltz, Peter W.; Strauss, Gregory P. (Journal article; Tidsskriftartikkel, 2022-06-23)
      <p><i>Background and Hypothesis:</i> Despite decades of “proof of concept” findings supporting the use of Natural Language Processing (NLP) in psychosis research, clinical implementation has been slow. One obstacle reflects the lack of comprehensive psychometric evaluation of these measures. There is overwhelming evidence that criterion and content validity can be achieved for many purposes, ...
    • Predicting self-injurious thoughts in daily life using ambulatory assessment of state cognition 

      Le, Thanh P.; Moscardini, Emma; Cowan, Tovah; Elvevåg, Brita; Holmlund, Terje Bektesevic; Foltz, Peter W.; Tucker, Raymond P.; Schwartz, Elana K.; Cohen, Alex S. (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-04-12)
      Self-injurious thoughts (SITs) fluctuate considerably from moment to moment. As such, “static” and temporally stable predictors (e.g., demographic variables, prior history) are suboptimal in predicting imminent SITs. This concern is particularly true for “online” cognitive abilities, which are important for understanding SITs, but are typically measured using tests selected for temporal stability. ...
    • Psychiatric Risk Assessment from the Clinician´s Perspective: Lessons for the Future 

      Cohen, Alex S.; Fedechko, Taylor L.; Schwartz, Elana K.; Le, Thanh P.; Foltz, Peter W.; Bernstein, Jared; Cheng, Jian; Rosenfeld, Elizabeth; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-06-01)
      Accurate prediction of risk-states in Serious Mental Illnesses (SMIs) is critical for reducing their massive societal burden. Risk-state assessments are notably inaccurate. Recent innovations, including widely available and inexpensive mobile technologies for ambulatory “biobehavioral” data, can reshape risk assessment. To help understand and accelerate clinician involvement, we surveyed 90 ...
    • Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function 

      Foltz, Peter W.; Chandler, Chelsea; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-22)
      Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions ...
    • Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function 

      Foltz, Peter W.; Chandler, Chelsea; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-22)
      Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions ...
    • Towards a temporospatial framework for measurements of disorganization in speech using semantic vectors 

      Holmlund, Terje Bektesevic; Chandler, Chelsea; Foltz, Peter W.; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-11-10)
      Incoherent speech in schizophrenia has long been described as the mind making “leaps” of large distances between thoughts and ideas. Such a view seems intuitive, and for almost two decades, attempts to operationalize these conceptual “leaps” in spoken word meanings have used language-based embedding spaces. An embedding space represents meaning of words as numerical vectors where a greater proximity ...
    • Translating Natural Language Processing into Mainstream Schizophrenia Assessment 

      Elvevåg, Brita; Cohen, Alex S. (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-01)
      Natural language processing (NLP) is a multidisciplinary field that involves objectifying aspects of language. Specifically, it understands human language by leveraging statistical and linguistic knowledge. NLP’s potential for enhancing the administration, accuracy, and objectivity of clinical assessments in psychiatry has been touted, as well as its potential for promoting equity in health care. ...
    • Updating verbal fluency analysis for the 21st century: Applications for psychiatry 

      Holmlund, Terje Bektesevic; Cheng, Jian; Foltz, Peter W.; Cohen, Alex S.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-02-07)
      Evaluating patients’ verbal fluency by counting the number of unique words (e.g., animals) produced in a short-period (e.g., 1–3 min) is one of the most widely employed cognitive tests in psychiatric research. We introduce new methods to analyze fluency output that leverage modern computational language technology. This enables moving beyond simple word counts to charting the temporal dynamics of ...
    • Using automated syllable counting to detect missing information in speech transcripts from clinical settings 

      Diaz-Asper, Marama; Holmlund, Terje Bektesevic; Chandler, Chelsea; Diaz-Asper, Catherine; Foltz, Peter W.; Cohen, Alex S.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-07-05)
      Speech rate and quantity reflect clinical state; thus automated transcription holds potential clinical applications. We describe two datasets where recording quality and speaker characteristics affected transcription accuracy. Transcripts of low-quality recordings omitted significant portions of speech. An automated syllable counter estimated actual speech output and quantified the amount of ...
    • Validating Biobehavioral Technologies for Use in Clinical Psychiatry 

      Cohen, Alex S.; Cox, Christopher R.; Tucker, Raymond P.; Mitchell, Kyle R.; Schwartz, Elana K.; Le, Thanh P.; Foltz, Peter W.; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-06-11)
      The last decade has witnessed the development of sophisticated biobehavioral and genetic, ambulatory, and other measures that promise unprecedented insight into psychiatric disorders. As yet, clinical sciences have struggled with implementing these objective measures and they have yet to move beyond “proof of concept.” In part, this struggle reflects a traditional, and conceptually flawed, application ...